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ABSTRACT 

The evaluation summary covers the first year's 
operation of tho Appalachia Educational Laboratory's Employer-Based 
Career Education (AEL/EBCE) program. The report's first section 
describes the student^ employer-related^ and parent-related goals of 
the program; program operation and costs; and replication concerns 
(transportation, costs per student, site coordination, and 
translation of student vork into academic credit) . Another section on 
methodology describes the students and employers who participated in 
the program, the program's treatment of the students and employers, 
and the design and use of the various instruments used in the program 
evaluation. A third section on results considers students* academic 
achievements, career maturity, attitudes tovard EBCE and 
miscellaneous student indicators, and parents' and employers' 
reactions to the program. Tvo final sections present a summary and 
conclusion and a discussion of the evaluation. Eight appendixes vhich 
collectively comprise 25 pages include: number, title, and authors of 
FY 1973 EBCE Evaluation Reports; numbers of students placed at 
employer sites 1972-73; employer site/cluster distribution; semantic 
differential; activity sheet; student interview form; parent 
interview schedule; and parent questionnaire. (JR) 
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Preface 

One of the four career education modals sponsored by the National 
Institute of Education is Enqployer*Based Career Education (EBCEi* A major 
problem focus of EBCE is the unpreparedness of youth for enplpyment, further 
study, and adult life. Ihe education setting is shifted from the existing 
sdxool systes to an adult, enployerHbased and action learning environment. 

One of four concurrent preliminary tests of the EBCE model has been 
completed by the Appalachia Educational Laboratory, Inc. (AEL) during the 
1972*73 academic year. The results of the AEI{/&BCE test are summarised in 
the following report. The focus of this sunaaxy is the degree to ^icfa 
previously established program objectives were met upon completion of the 
first test year, and the substance of the smmnary is based on nine separate 
evaluation studies presented in a technical report series. 

Dr. James H. Sanders, Evaluation Specialist, was responsible for EBCE 
evaluation design, data collection and reporting and worked under the 
general direction of Dr. Charles L. Bertram, Director of Research and Evalua- 
tioa for the Laboratory. Data analysis and tedmical report preparation for 
the evaluation studies were subcontracted to Dr. James T. Hanson and Dr. Jc^n 
T. Seyfaarth of the West Virginia College of Graduate Studies during the sxim* 
mer of 1973. Dr. Ermel Stepp, Evaluation Specialist with the Laboratory, 
also assisted with data analysis and report preparation* Meinbers of the 
EBCE design and operati<ms staff reacted to early drafts of all reports, 
including this summary, in order to increase the tedmical quality of the 
reports and to insxure that the first year evaluation resxilts are appropriately 
used in R 74 program planning and operation. 
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Introduction 

The purpose of this r.ujnnary evaluation report is to present an integrated 
synopsis of several evaluation studies conducted as a peirt of the Employer- 
Based Caree:. 'education (EBCE) program development effort during the year 
beginning September, 1972, and ending June, 1973. The purpose of these 
studies was to determine if the stated objectives of the program were met 
during the year, and to docuooent the implications of the findings for the 
EBCE program. 

The separate evaluation studies are reported in a series of tedinical 
reports which treat the different arsas of measiirement in considerably more 
detail than can be afforded in this summary. For example, the report entitled 
Employer-Based Career Education; Analysis of Scores on the Career Development 
Inventory (Technical Report No. 37) gives a detailed description of the instru- 
ment, tables of data, and a detailed report of interpretations which are based 
on interaction with EBCE program staff who worked daily with the students. 
These technical reports are referenced throughout this report as additional 
detail is useful but too cumbersome to include in the suxnnary. A list of 
available EBCE evaluation reports is given as Appendix A. 

The differentiation between formative and summative evaluation is usually 
according to the intended use of the results. The function of formative evalua- 
tion is to indicate needed changes in the program as the program is being 
developed. The purpose of summative evaluation is to indicate (usually to 
consumers) if the total program has reached its goals or objectives. Since 
the purpose of the EBCE evaluation studies was to determine if the objectives 
of the program had been met by the end of the first academic year, the report 
may be considered summative in intent so far as the past year a972-73) is con- 
cerned. However, since the EBCE program staff has reacted to each of the 



reports and freqxiently suggested l3i5)lications for program change for the 
current year (1973-74) , the fxmction of the report may also be considered 
formative. 

As recently indicated in the Guidelines for Preparing Evaluation Plans 
for Model II provided by the National Institute of Education,^ the general 
purposes of evaluation for program development are: (1) to provide informa- 
tion on the effectiveness of the program in reaching specific objectives, 
(2) to provide information vrtiich may lead to program revision, and (3) to 
give an indication of the resources, including costs, required for the program 
objectives to be met. This report does indicate the degree to which identified 
program objectives were met during the past year, and information is provided 

which is leading to program revision during the year beginning September, 1973, 

2 

Intensive cost studies are planned for the year beginning in September, 1973, 
but were not couple ted during Uie initial year of development. Only approxima- 
tions of past cost requirements and goals for future requirements are contained 
in the following report. 

The organization of the report is first to describe the EBCE program (what 
it is) , relate the degree to >^^ich objectives were met (what it did) , and to 
summarize implications for change. Ihe program description will include a 
statement of the goals and objectives of the program, and a section on method- 
ology which will describe the instruments and other evaluation procedures. 

^National Institute of Education. Guidelines for Preparing Evaluation 
Plans for Model II . (Washington: NIE, April 19, 1973), p. 4. 

2james H. Sanders. Employer-Based Career Education Program: Summative 
Evaluation Plan . (Charleston, W. Va. : Appalachia Educational Laboratory, 
Inc., July, 1973), pp. 17-19. 
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Program Description 

In June of 1973 , the Appalachia Educational Laboratory (AEL) completed . 
the first year of developxaent and testing of the EBCE program^ The AEL/EBCE 
program is one of fovu: such developmental programs funded by the National 
Institute of Education for the purpose of providing an alternative educational 
experience for a cross section of high school age youth. The AEL/EBCE program 
is characterized by emphasis on direct employer site experiences; personaliza- 
tion of each student's program in tezms of individual needs, interests, and 
abilities; supplementation of field experience with academic learning center 
activities and instruction; and translation of the learning experiences into 
credits acceptable to the school system for the granting of diplomas. 

The AEVBBCE program is designed and developed for the purpose of helping 
each student develop the skills needed to live and helping each student to 
live his life as a more con?>lete human being. Ihese life skillc are designed 
to include career, social, and avocational goal identification, and decision- 
medcing skills. 

A more complete defjcription of the AEL/EBCE program including a "walk- 
through" of an actual student from recruitment to completion of the program 
is given in the Executive Summary of the FY 1974 Operational Plan.^ 

The AEL/EBCE efforts for FY 73 were guided by the following set of goals 
which were identified and refined through interaction of the program staff and 
the evaluators. These goals indicate expected outcomes from students, employers, 
and parents, and were used as a point of departure for the evaluation of the 
program.^ 

lAppalaAia Educational Laboratory, Inc. En^loyer-Based Career Education 
Program Operational Plan, FY 1974 Executive Sucmtary. (Cheurleston, W. Va. : AEL, 
July, 1973) , p. 2. 



"^James H. Sanders. Outline of Product Evaluation Plan for Employe r-B as ed 
Career Education. (Charleston, Va. : Appalachia Educational Laboratory, 
0 •/ 1972). K " ^ 
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Student Goals > Consistent with each student's program profile, i.e., 
needs and interests, and given a reading ability level of at least grade 6.0 
as measured by a nationally recognized test instrument, AEL/EBCE program stu- 
dents should be able to: 

3 . Make a realistic career choice based on abilities, interests, 
and values and the requirements of selected career cureas. 

2. Increase their knowledge of the variety of opportunities in 
the world of work. 

3. Identify the functional, adaptive, and specific skills required 
for selected work situations of their choice. 

4. Develop acceptable problem-solving, planning, and decision- 
making skills* 

5. Document their educational needs (with the assistance of staff) 
in relation to their career and/or academic goals. 

6. Develop the skills and education necesseu:y to enter their career 
area or pursue their career at a higher educational level upon 
coTOletion of grades ten throu^ twelve. 

7. Develop the communication skills necessary to function competi- 
tively in the career areas of their choice. 

8. Develop their abilities, interests, and values within the context 
of selected career areas in order to become a more valuable citi-- 
zen for society, and to develop competence in their social and 
personal skill areas. 

9. Identify some social issues which can be critically examined in 
the context of selected career areas and/or the surrounding 
community. 

10. Critically examine one or more social issues in the context of 
career areas and/or the surrounding community. 

11. Evaluate their value «;ystem against encountered views on social 
issues and change, modify, or defend their value system accordingly. 

12. IdA-ntify the opportunities in the community and the world of work 
which can be used for fulfilling personal, social, and recreational 
interests. 

13. Possess the minimum essential skills and knowledge necessary for 
utilizing the opportunities in the community and the world of work 
to fulfill their poriional, social, and recreational interests upon 
conpletion of grades ten through twelve. 
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Enployer-'Related Goals > Each cooperating enployer will: 

1. Identify and provide a resource person in their einploy to work 
directly with EBCE students. 

2. Provide direct assistance r through the resource person^ tu 
help students to satisfactorily complete EBCE activities at 
their sites* 

3. Provide interested students with motivation and specific ways 
to expand and/or gain Icnowledge for becoming qualified in a 
caoreer sarea* 

4. Have a positive attitude toward their role and a sense of 
greater responsibility in the education of today's youth. 

5. A specific group of eii5)loyers (a consortium) will agree to 
manage a segment of a caureer education urogram during the 
1972-73 acaddtnic year. 

Parent Related Goals. Parents of participating youth will have a 
positive attitude toward the AEL/EBCE prograua. 

Additional program development goals stated near the beginning of the 
program year required the production of certain descriptive documents. Their 
production was later postponed through agreement with the National Institute 
of Education. The consensus was that documents descriptive of the operation of 
EBCE should be produced after the program had attained stabilization. 

Program Operation and Costs 

Program costs for FY 73 were accounted for on a line item basis. It was 
therefore not feasible to obtain a oist analysis by program function. A major 
cost analysis effort is planned for FY 74. Although a cost analysis was not 
accomplished, it is possible to report on the people resources needed to oper- 
ate the program. 

There were 44 students in the program the last half of the year. A total 
of five full piroe professionals were used to interact directly with students. 
One professional worked full time as a counselor and school liaison person; 

ERLC 
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one professional worked full tinae identifying and making necessary arrange- 
ments with employer sites for students; and one professional worked full time 
as an operations manager. Two non*»professional staff members worked full time 
at clerical and 1:ransportation duties* 

Replication Ooncems 

Transportation > Parents' greatest concern was the transportation problem. 
There was an extensive amount of transportation required in the EBCE program, 
cind pxablic transportation was not readily available at all times to all neces- 
sary places in the geographical area served by the program. Transportation 
may or may not be a major problem in some other metropolitan area. 

Cost Per Student . There wais considerable evidence from observing EBCE 
staff that tl»ey were working full time with a small number of students. A 
good deal of efficiency must be gained if the program is to become a bonafide 
alternative to piablic school education. 

Site Coordination . The tracking of students as they move all over the 
metropolitan curea and the possible overloading of employees as the nuxnber of 
students and EBCE staff increase could present a major replication prdDlem. 
Ths logistics and coordination efforts needed may or may not be a major prob- 
lem if a much larger number of students become involved with the program. 

Translation of Student Work into Academic Credit . In most senior high 
schools, academic credit is determined primarily by the Carnegie unit method 
which is based upon the amount of classroom time involved and by a comparison 
of effort with some common outcome measures. The EBCE program is burdened 
with the task of trying to convert an entirely different individualized and 
personalized approach into the conventional type of acad^nic credit so that 
students can graduate from high schools. T?.iis problem will be more acute if 
the program expamds downward into the 10th and 11th grades. 
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Methodology 

The methodology section of this report is a description of the partici- 
pants in the AEL/EBCB program and of the instrumentation and other evaluation 
procedures that were used to determine if program objectives were met* 

Siibjects 

At least two different gro\5>s of individuals might be considered ''sub- 
jects" in a desired sense* In addition to the students, attainment of program 
objectives required that certain changes take place in employers. These 
changes may be considered a program effect. 

Students 

Students were recruited from the 12th grade class of the Kanawha Coxinty 
Sdiools in and near Charleston, West Virginia. Students volunteering to be 
participants in the EBCE program came from the following high schools: 
Charleston High (7), Dunbar High (8), George Washington High (6), Herbert 
Hoover High (1), Nitro High (5), and Stonewall Jackson High (17). 

Twenty-two students were selected to begin the EBCE program in September^ 
1972. One of these 22 students returned to his previous high school after two 
days. The one dropout gave two reasons for withdrawal from the program: (1) 
the proximity of the home high school (across the street from the student* s 
residence) and (2) a desire to participate in the home school activities. 
The remaining 21 students who entered the program in September of 1972 and com- 
pleted the program in June of 1973 will be identified as Group I throughout 
this report. 

Twenty-three sttadents were selected to enter the EBCE program during the 
second semester cf their senior year, and all 23 r^iained with the program 
until June. This group, who entered in January of 1973, will be identified 
as Group II throughout this report. 



8 



The following set of criteria used to select the 44 students give an 
indication of the type of students who participated in the program* The 
criteria were: 

1* The students should be eligible for enrollment in the Kanawha 
County school system. 

2. Enrollees should be within one year of ccmpleting their high 
sdiool diplcma. 

3. They should have specific course requirements that could be 
fulfilled within the time they would be in the EBCE program. 

4. P€u:ticipants should volunteer r and have their pzurents' consent* 

5* There should be a ccopatibility of expressed career interests 
on the part of students with program capability to meet those 
interests. 

6. Students should be willing to participate in work activities 
that would not conflict with the program. 

7. The students should be able to provide transportation to and 
from the EBCE site. 

8. Participants should possess no major health and adjustment 
barriers as revealed by appropriate examination. 

9. Students should have been enrolled in regular classes all of 
the preceding semester. 

10. The students must not be under suspension or threat of sus- 
pension by any school system. 

11. They should not have conaaitments which would interfere with 
involvement in the EBCE program (e.g.^ band, athletics r etc.). 

12. As a group, the students should reflect a broad range of 
ability and socio-economic levels. 

13. The students should meet other criteria not in conflict with 
the above but required to fulfill the program mandate. 

The 44 students who participated in the EBCE program represented a wide 

range of academic ability and career interests. For example, the enrollees 

included two Merit Scholarship finalists as well as students with limited 

academic abilities. The first group of 21 students (Gro\:^ I) which was in the 



program the entire school year needed an average of 2.69 credits to graduate, 
one credit is equivalent to one year of work in an academic subject. Twenty- 
three Group II students who were in the program for only the second semester 
needed an average of 1.22 credits to graduate. Table 1 is a representation 
of the average number of credits needed and earned for eadi group as well sis 
a listing of the number of students needing credit in identified academic 
areas and the number of students receiving sudi credit. 

There were 4 girls and 17 boys in the first group of students, and 
Group II contained 13 girls and 10 boys. Six of the 44 students were blade 
(three from each group) , whereas 38 of the 44 students were white. 

The grade point average for Group I students prior to entering the EBCE 
program was 1.99; whereas the grade point average for the Group II students 
was 2.45. Grade point average was determined by assigning the ntmber 4 for 
an A, 3 for a 2 for a C, 1 for a D, and 0 for an F. Physical education 
grades were not used in determining grade point average. Grade point average 
was calculated by using all grades received from entrance into the 9th grade 
until entry into the EBCE program. 

Reasons why the students volunteered to participate in the program were 
identified through student interviews conducted during May of 1973. The 
primary reason given for volunteering for the program was to learn about or 
try out jobs. Other reasons were to get a break from routii*e/ or they expected 
to have some independence and self-direction through participating in the EBCE 
program. Additional information concerning why students volunteered and what 
they expected from the EBCE program are presented in Technical Report No. 42, 
Students* Attitudes Toward the Program as Indicated by an Analysis of Interview 



Data. 
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Table 1 

Credits Needed and Heceived FT 73 

Group I Grot^ II 

Students Students** 

English 

Number of Students Needing Credits 19 23 42 

Nuiober of Stiidents Receiving Credits 18 23 41 



Mathematics 

Number of Students Needing Credits 10 1 

Number of Students Receiving Credits 7 10 17 

Science 

Number of Students Needing Credits 4 0 4 

Number of Students Receiving Credits 9 9 18 

Social Studies 

Number of Students Needing Credits 6 7 13 

Number of Students Receiving Credits 16 16 32 

Total Credit* 

Credits Needed per Student 2.69 1.22 

Credits Received per Student 4.77 2.61 



*1.0 credit is equivalent to one year*s work in a subject area. 

♦♦Group II students entered the program in midyear and therefore were only 
one-half year from graduation. 
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A detailed description of 1972-73 EBCE students' backgroxjnd data is pre- 
sented in Otechnical Report No. 36^ Selected Demographic Data from Studeft ts in 
the 1972-73 School Year. 

Employers 

A total of 64 employer sites were available for EBCE students during 
FY 73 (see i^pendix Bl . These employers were selected for the following 
reasons : 

1* To provide students with at least one possibility in each of 
the 15 career clxxsters (see Appendix C) . 

2. To meet individual student needs on occsisions requiring some 
specialized type of eisoployer site. 

3. Personal knowledge and contacts, with top executives, by the 
employer liaison staff person and by various m embers of the 
advisory council. 

As indicated by Table 2, the 64 employer sites represented a wide cross 
section of possible sites available throughout Kanawha County. Employer sites 
were classified (for this report) under two categories — size and public versus 
private* The large en^Jloyer sites were those organizations en^loying 100 or 
more people; medium en^loyer sites employed 10 to 99 people; and the small 
en^loyer sites employed less than 10 people. 

Table 2 

Classification of Employer Sites 

Large Medium Small Total 

7 16 16 39 

S 11 6 25 

15 27 22 64 



Private 
Public 
Total 



Treatment 

Students 

It is necessary, in order to adequately describe the students* educational 
program, to first describe some roles of various EBCE staff persons. Students 
were placed into a program steiffed by seven to nine profession2dly trained 
people. The director of this staff had the title Associate Program Director 
and was in ch2u:ge of operations. This was a role that could most cleearly be 
aligned with the principal's role in the tr2iditional hig^x schools. A second 
staff person was a trained counselor and performed student counseling-type 
duties and program coordination duties. A third person was primarily respons- 
ible for obtaining specific en?)loyer sites for students. The remaining pro- 
fessional staff members had one of two distinct titles and roles- The job 
titles were Program Manager and Instructional Manager. The Program Manag er 
was responsible for planning^ coordinating, and monitoring the educational 
program of seven to ten students. The Program Manager wais sometimes a co\m- 
selor, sometimes a monitor and student critic, and sometimes em enabler for 
students. The Instructional Manager was a sxibject matter specialist, and 
MBS responsible for identifying, prescribing, and evaluating the personalized 
subject matter activities for all students who either needed or wanted work 
in that particular subject area. In essence, the InstructioneJL Manager 
designed, prescribed, and evaluated a curriculum for each student that par- 
ticipated in that subject area. 

Students participated in orientation sessions their first two to three 
weeks in the EBCE program. The purposes of the orientation period were to 
acquaint the students with the program procedvures , objectives, and rules; 
acquaint the students with the EBCE staff; and to obtain data from each 
student on which their program could be built. Students indicated (with 
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assistance from their home sdiool counselors) how many credits were needed 
and in which eireas in order for them to graduate from their home school. 
Students also indicated, at this time, the careers in which they were inter- 
ested and the academic eirects of particular interest to them. Students and 
Instructional Managers jointly prepared a course of study designed to accoramo- 
data student needs and interests. 

Students were assigned to a specific Program Manager. The student and 
the Program Manager worked jointly in coordinating euid monitoring the adopted 
course of stu^. They identified the type and/or the specific employer site 
which they wanted to e^lore and stu^. The employer liaison person made 
the contacts with the employer and arranged the final details of the visit.. 
Students met with the individual Instructional Managers, which had been 
identified in their course of stuc^, at least one or two times each week. 
These meetings were individual appointments and were used to discuss the 
student's specific activities, to evaluate the student's activities, and to 
identify and develop the next specific activity in that particular academic 
area* 

Students usually were at employer sites three out of five days each 
week. The remaining time was usually scheduled with Program and Instructional 
Managers at the learning center. 

Employers 

The AEL/EBCE employer liaison person was the primary contact between the 
EBCE program and employers. The employer sites were first contacted through 
the top executive by the employer liaison person. It was through this meet- 
ing that the EBCE program was able to determine if that employer site could 
or could not be utilized by the EBCE students. If the top executive agreed to 



f'\ cooperate with the EBCE program, an employer contact person was identified 
and certcon employer site specific ground rules identified* The es^loyer 
contact person was frequently a middle management person in the organization 

\, and was given re'sponsibility to coordinate student requests with the EBCE 

y employer liaison person* The employer contact person identified a specific 
employer resource person after receiving a formal request* The student 

I interacted and maintained close liaison with this resource person during his 
or her tenure at the employer site* In a formal sense, the identified con- 
tacts at a site are the top executive, employer contact person, and the 
employer resource person. This, however, varied with the size of the employer 

^ site since a small or sometimes medium-sized enqplcyer site might require two 
or sometimes all three roles to be filled by the same person* 

Instrumentation 

Instr\aments were primarily identified or designed to assess program 
^ intact. The following instruments were administered during FY 73. 

1. The Iowa Tests of Educational Development (ITED) was given 
to all EBCE students , The ITED is an achievement test 
battery which has norms for grades 9, 10, 11, and 12. The 
battery consists of siibtest scores in reading, Icinguage 
arts, mathematics, social studies backgrovmd, science back- 

; ground, use of sources, and a ccxnposite score. 

2. The Career Development Inventory (CDI) was administered to 
all EBCE students. The CDI is an instrument developed by 
Donald E. Super and David J* Forrest of Columbia University 
to measure various aspects of career maturity. The instru- 
ment yields subscores in: (a) Planning Orientation which 



represents the degree to which the student is able to use 
information in planning; (b) Resources for Exploration 
which is a self-rated assessment of the used and available 
resources for use in planning for a caureez; and tc) Infor-- 
matron and Decision-Making/ a cognitive measure of a san5)le 
of the amount of educational and occupational information 
the student has acquired along with his mastery of the use 
of information for sound decisions. 

3. An AEL-developed Semantic Differential was administered to 
all EBCE students. The Semantic Differential is an instru- 
ment designed to measure the psychological mecuiing vhich 
people have of various concepts. Kerlinger^ refers to the 
use of a semauitic differential to study attitudes people 
have toward certain concepts at a specific time. Ihe AEL 
semantic differential was designed to measure the attitude 
and possible change in attitude of the EBCE students on the 
following concepts : chances for success in life , future 
career plans, responsibility to the governance of the com- 
munity, education, themselves, recreation facilities avail- 
able in the community, social contributions of the comn^unity 
to their well •)eing, occupations, and their contributions 
to their conmunity. A copy of the AEL/EBCE semantic dif- 
ferential is included as Appendix D. 

4. The Kuder Occupational Interest Survey (KOIS) Form DD was 
administered to all EBCE students. The Kuder is a 



^Fred N. Kerlinger. Foundations of Behavioral Reseairch* (New York 
f Rinehart and Winston, Inc., 1967). 
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standardized instrxanent designed to provide information to 
students about their occupational interest patterns. 
5* The Student Information System Questionnaire (Level II) was 
administered to all EBCE students. The SIS questionnaire 
was developed to generate data from students concerning their 
interests, attitudes, and plans. Seven subtest scales were 
utilized in the FY 73 evaluation efforts. Ihe noM assigned 
to these scales are: (1) cognitive skills, (2) learning 
attitudes, (3) psychomotor creativity, (4) personal adjust- 
ment, (5) maturity, (6) social adjustment, and (7) flexibility. 
The SIS questionnaire was also used in providing student 
demographic data. A detailed description of the SIS question- 
naire and results are available in Technical Report No. 41, 
Analysis of Data from the Student Information System . 

6. Activity Sheets were used by Program Managers, Instructional 
Managers, and by students. The activity sheet (see Appendix 
£) was primarily used to present a precise and specific 
learning activity to an individual student. The activity 
sheet was to contain infoimation about the specific objective, 
the amount of time needed to complete the activity, specific 
details and resources available on the activity, and closing 
comments and assessment of the activity by both the student 
and the Instructional Manager. Specific details and report 

of the activity sheets are available in Technical Report No. 
44, An Investicfation of the Use of Student Activity Sheets. 

7. A structured interview was administered to all students at the 
end of the program year. The student interview was primarily 
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structured to obtain information about students' attitudes 
toward the EBCE program, their career plans, the effect 
of EBCE on the students, and students' reccnmendations for 
further development. A copy of the Student Interview 
schedule is included as Appendix F* 
8. parents of the EBCE students were interviewed after the 
students had graduated from the program. The primary pur- 
pose of the p2u:ent interview was to obtain parents' attitudes 
toward the EBCE program and their perception of the effect 
of the EBCE program on their sons and daughters. A copy of 
the parent interview schedule is attached as Appendix G. 

Design 

EBCE students were administered the Iowa Tests of Educational Development 
(ITED) , the Career Development Inventory (CDI) , the AEL/BBCE Semantic Differ- 
ential , and the Kuder Occupational Interest Survey at entry into the EBCE pro- 
gram and at the end of the academic yearc Symbolically, the design for Group 
I students on each of the above students was 0^ X O2 X O3, where Oi symbolizes 
the September administration of the above instrmentSi O2 the winter adminis- 
tration, O3 the spring administration, and the X symbolizes an intervening 
treatment period. The symbolic design for Group II on each of the above 
instrxaments (using the same symbol interpretation) was O2 X O3. A Student 
Information System Questionnaire (SIS) was administered to all students in 
the winter administration period and in the spring administration. Students 
were interviewed about various aspects of the program at least four times 
during the year; however, a structured interview was administered only at the 
end of the academic year. 
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All parents were given a qaestionnsure designed to provide their reac- 
tions of and attitudes toward the EBCE program after the first nine weeks of 
the program* A saaple of parents (33% of the parents) were interviewed via 
telephone near the end of the first seiaester of the program. This interview 
was designed to aacertzdn attitudes toward the program and especiedly to 
get their reaction to a particular EBCE form that was being developed. Efforts 
were made to contact and interview all parents after the close of the school 
year. Interviews were conducted with one or more parents in 31 of the 44 
(70%) possible families. 

Results 
Students 

Academic Achievement 

The Iowa Tests of Educational Development (ITED) were administered to 
all students to determine whether EBCE students demonstrated normal academic 
growth. All students were given Form X5 of the ITED as a pretest and Form 
YS of the ITED as a post- test, l^ere was a span of approximately eight months 
between testing for the first group of students (Group I) and a span of approx- 
imately three and one-half months between testing for the second group of 
students (Group II) . Group I students were also administered Form X5 of the 
ITED in February (and at the ssux^ time as the pretest for Group II) . 

Student scores were converted to growth scores according to a procedure 
based on Thurstone's absolute scaling procedures^ so that an indication of 
student growth rate could be obtained. A student's growth rate score was 
obtained by subtracting the pretest growth score from the post-test growth 

^Science Research Associates. SRA Assessment Survey » 1971 Growth Scale 
Curves , No. 18-145. (Chicago: SRA, April, 1972) (mimeographed) citing 
Harold GulliJcsen. Theory of Mental Tests. (New York, 1950, pp. 284-186). 
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scx>re. Since growth rate score norms for 12th grade students were not avail- 
able # an approximation of these norms was developed from 12th grade October 
and May growth score norms. The approximation for a 12th grade growth rate 
score was c±)tained by subtracting the October growth score mean from the May 
growth score me2m (from national norms ^) . 

Growth rate scores for Group I of the EBCE program and the approximate 
growth rate means are presented in TaDie 3. 



Table 3 

comparison of Growth Rate of EBCE Group 1 Students 
with National Norms 





Comp. 


Reading 


Language^ 
Arts 


Mathematics 


Social 
Studies 


Science 


Use of 
Soxirces 


^2 - ^1 


12.10 


2.24 


17.91 


13-71 


16.81 


7.38 


0 


" Mo* 


8 


6 


7 


2 


7 


4 


5 



♦Growth Score Means from National First Semester Norms of 12th grade students 
(VIq) and of 12th grade second semester norms . 

^This JLS a comparison of the Group I EBCE students with national norms only 
since the Group II EBCE students were in the program less than one full 
semester. 

^There was a significantly greater growth in language cirts (p<.10) . 

A statistically greater than expected growth rate (p<.10) was found in the 
Language Arts subtests for Group I. Although not statistically significant, 
greater than expected growth rates were observed in mathematics, social studies, 
science* and in the composite scores. A small growth was indicated in reading, 
and no growth was demonstrated in the Use of Sources subtest. 



Ibid. 
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Since the period of time between pretest and post-test of the second 
group of students was only three and one-half months* meaningful growth rate 
coii5)arisons are difficult to make. It would appear, however, the growth 
can be obser^/ed from the language arts subtest. An aneilysis of growth scores 
of all stud<5nts for all testing periods indicated the greatest growth in all 
subtests was during the first semester and there was a slight decrease in 
scores the second semester (see Table 4) . 

An analysis of February scores of both gro\:5)s of students indicated no 
significant differences between the two groups of any of the subtests. This 
observation was noticeable particularly since there was substeintial differences 
between the two groups in grade point averages. As mentioned previously. Group 
X had a GPA of 1.99 prior to entering the program, whereas Group II had a GPA 
of 2.45 prior to entry into the program. 

Both groups of students scored below the national norms on all except the 
mathematics subtest. The mathematics subtest scores were greater than the 
national norm (p<.0001) . 

A detcdled discussion and analysis of the ITED is available from Te'chnical 
Report No. 38, Analysis of Scores on the Iowa Tests of Educational Development . 

A second indication of academic achievement can be obtained by comparing 
student credit needs^, for graduation with credit received while in the EBCE 
program, it can be observed from the data of Table 1, page 10, that students 
received almost two times the number of credits they needed for graduation 
while in the EBCE program. All but two students needed credit in communication 
skills (English) and all but one of those students received the credit needed 
and that credit was received during the summer. One student needed credit in 
mathematics and 17 students received credit. Four students needed credit in 
science, vrtxereas 18 students received credit, and tliirteen students needed some 
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credit in social stxidies but 32 students received academic credit. This is 
evidence that the students did participate in academic study beyond what was 
needed "to get by". 

A sample of second semester student activity sheets was reviewed and 
critiqvied by evaluators from outside the Laboratory. The evaluate rs concluded 
that there was considerable evidence of individualization of student academic 
activities and that imagination was used in developing the student activities. 
However, the evaluators reported considerable evidence of a lack of orderly 
sequencing of student activities within an academic area. A detailed report 
and ancLLysis of student activity sheets is available in Teciinical Report No. 
44, An Investigation of the Use of Student Activity Sheets. 

As reported in the student interviews, nearly 30% of the students said 
they worked hcurder in the EBCE program than they did in their home school/ and 
only approximately 14% of the students felt they worked harder in their home 
school. Approximately one-half Of the students believed they learned more in the 
EBCE program than they did in the heme school, and less than 5% of the students 
felt they learned more in the hoine school. Some of the reasons given by students 
to support their positive attitude toward the EBCE program were: the activities 
were more interesting; they could work the activities at their own speed; and 
in the home school they just sat in the class every day. A detailed description 
of an analysis of student interview da<;a can be found in Technical Report No. 
42, Students ' Attitudes Toward tne 'ogram as Indicated by an Analysis of Inter- 
view Data . 

Parents were asked the following question in an interview: "Do you believe 
yoxir child learned as roudi in his/her subject areas this year as compared to 
Icist year?" Of those parents interviewed, more than 61% did believe the students 
learned more from the EBCE program, approximately 22% felt there was no differ- 
ence, and less than 4% (one parent) felt that the home school was si5)erior to 
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the EBCE program. A detailed description of parent interview data can be 
fotand in Technical Report No- 43^ Parents* Attitudes Toward the Program 
as Indicated by an Anatlysis of Interview Data- 

Scores were analyzed from the Student Information Systoa Questionnaire 
II (SIS) on cognitive skills and on learning attitudes. .The cognitive skills 
scx>re is a measure of basic learning aptitudes- General cc!nprehension, read- 
ing r speaking^ and general learning skills are included in this scale. The 
learning attitudes scale is an indication of the student's attitude toward the 
learning skills of concentration^ organization^ dependability, and willingness. 
Students were given the SIS in February and in May, and it is therefore diffi- 
cult to conntent on gains or losses made over that short span of time. The 
second group of students did score higher than the first grovip in learning 
attitude. The second group scored approximately at the norm on the learning 
attitude scale whereas the first group scored significantly below the nom 
{p<.01) . Both groups scored significantly below the norm on the cognitive 
skills scale (p<-05) as indicated in Table 5. A detailed discussion of the 
SIS analysis can be found in Technical Report No. 41, Analysis of Data from 
the Student Information System , 

Table 5 

Mean Scores on the Cognitive Skills and Learning Attitude Scales 
of the Student Information SystCTi by Student Group 
and Testing Period 





Group 


I 


Group 


II 


SIS Scale 


Winter 


Sprina 


Winter 


Sprinq 


Cognitive Skills* 


49.10 


45-70 


45.60 


43.80 


Learning Attitude* 


42-45 


43-35 


51.10 


52.50 



*The norm on all tests is 50. 
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Career Matxirity 

An important objective of the EBCE program is to prepare students to make 
career decisions and to develop certain skills needed to enter the career. 
Career matxirity in this report will include concepts such as making realistic 
career choices, knowledge of the world of work, problems-solving skills, plan- 
ning skills, decision-making skills, and career attitudes. 

The Career Decision inventory (CDI) was administered to all students as 
a pretest and as a post-test. The CDI was designed to measure three aspects 
of career maturity: Scale A, development of a planning orientation toward 
a ceureer; Scale B, familiaurity with and use of the resources which can be help- 
ftil in vocational exploration; and Scale C, knowledge of occupations and of 
career decision-making principles. 

The means and standeurd deviations on the three sxabtests and the total 
score for the two groups of students are presented in Table 6. Significant 
g5d.ns from the September testing were made by Group I on Scale A in February 
and in May. Group II had a positive gain; however, it was not a statistically 
significant gain. Groxjp I had a significant positive gain on Scale B in 
February. Both groups had a slight loss (non-significant) on Scale B in May. 
Group I had a slight loss on Scale C in February and a slight gain in May. 
Group II had a statistically significant loss on Scale C in May. Group I had 
aains on all subscales from the September administration to the May testing 
with largest gains appearing by February. Group II had overall losses in two 
of the scales and a gain in only one. 

There appears to be a cooqparatively large gsdn in the Febrtiary testing 
and a failure to sustain the growth rate through the May testing period- 

A detailed discussion of the administration and analysis of the Career 
Development Inventory can be found in Technical Report No. 37, Analysis of 
Gcores on the Career Development Inventory, 
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Table 6 

Subtest smd Totsil Means and Standard Deviations on the Career 
Development Inventory by Group and Month of Testing 



Scale 



Sept. Feb. May 

Mean SD Mean SD Mean SD 



Part A 

Group I 99.10 20.46 117.52 17.46 119.10 20.27 

Group II - - 103.43 17.73 108.00 19.19 

Part B 

Group I 255.76 53.03 271.43 54.31 263.57 60.75 

Group II - - 259.83 54.10 251.30 65.08 

Part C 

Group I 19.29 4.86 19»19 5.20 19.81 5.67 

Groi^> II - • 20.09 5.28 18.52 6.14 

Total 

Group I 374.14 65.67 408.14 64.86 402.48 78.50 

Group II - - 383.35 63.77 377.39 76.51 



Students were queried about their career plans in the final student 
interview. Twenty-seven of the 44 students (over 61%) reported firm cetreer 
choices/ another 18% had not made a choice, but had narrowed their interest 
field down by elimination, and another 20% either did not respond, had not 
made a choice, or had not narrowed down the field of interest. In every 
case, they reported that the EBCE program had influenced their career deci- 
sions* When asked what they (the students) had specifically gaiined from 
the EBCE program, at least 49% of the responses were related to occupational 
information or job-related skills. 

There was strong evidence from the student interviews that students were 
making realistic career choices. All of the students who planned to enter 
fields for which advanced training is required were planning to go on to seek 

: ERIC 
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such training, and those who were going into fields in inAiich training is not 
needed were not planning on acquiring any further education.^ 

Parents of the EBCE students were asked what the advantages of the EBCE 
program were over the home school. Although there were a variety of responses 
given, at least 42% believed it was the job information the students had 
received. A second question was asked to find out h<M the program had affected 
their child's career plans. Eighteen parents (58% of the respondents) reported 
that their child was more certadn of a career choice, 25% repo3rt:ed no change, 
and 7% said the child was less sure of a career dioice. 

Attitude Toward EBCE 

Students were interviewed at least four times during the school year in 
efforts designed to improve the EBCE program. In each case, atteir?)ts were 
made to determine the students* attitudes toward the EBCE progr^. In every 
interview period the students were very strong in attitude toward the EBCE 
program. At the end of the school year, the students were asked if they would 
pairticipate in the EBCE progreun again knowing vriiat they now knew. The response 
Wcis an overwhelming "yes" with 42 answering "yes" with no reservations, one 
answering "yes" with reservations, and one answering "no". At least 90% of the 
students felt the program had met or exceeded their expectations. A small 
nunfcer of the students said they did not have as much independence in the pro- 
gram as they thought they would have. 

Parents were asked how they perceived the student's attitude toward EBCE 
compared with the attitude toward the home sdiool. Over 96% of the parents 

•^John T. Seyfarthr Jamas Sanders, and Charles Bertram. Students ' 
Attitudes Toward the Program as Indicated by an Analysis of Interview Data. 
(Charleston, Va. : Appalachia Educational Laboratory, Inc.), September, 
1973, p. 23. 
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were convinced that their son or daughter weis much more positive toward the 
EBCE program than they were the heme school. One parent felt their child was 
more positive toward the home school than the EBCE program. 

Miscellaneous Student: Indicators 

Some p£u:ents and sc3ine of the students had indicated that a nimiber of the 
students would not have s\irvived the entire year at their home school. There 
were indications from seme that they would have dropped out of school. All 
students who entered the EBCE program {with the exception of the one student 
who went back to the home school after three days) coapleted the program. 

Student attendcince records were examined for FY 72 and FY 73. Although 
records were available for all students, the attendcuice records for the Group 
II students for FY 72 were not consistent. The Group I students were absent 
from their conventional high school cin average or 15.52 days during FY 72. 
The same groxjp of students was absent from the EBCE program an average of 
12.36 days during FY 73. 

Data from the Student Information System (SIS) Questionnaire were analyzed 
over seven different scales, two of which have already been reported. As men- 
tioned previously, it is difficult to make many conclusions about the effect 
of the program on these scales since the time between testing was only three 
and one--haif months. It is, however, appropriate to compare scores with 
established norms. Scores for both groups of students, on the five remaining 
scales are presented in Table 7. The norm to which all scores can be compared 
is a score of 50 on eadi scale. Both groups of students scored below the norm 
in personal adjustment, maturity, jsccial adjustment, and in flexibility (p<.001) . 
Students scored at or above the norm on psychomotor creativity. A detailed 
report of the analysis of the SIS can be found in Technical Report No. 41, 
Analysis of Data from the Student Information System . 
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Table 7 



Mean Scores on Five Scales of the Student Information System 
According to Student Group and Testing Period 



Group I Group II 

Winter Spring Winter Spring 



Psychomotor Creativity 


55.00 


52.80 


49.60 


49.85 


Personal Adjustment 


28.45 


29.70 


25.40 


29.35 


Maturity 


26.25 


28.15 


16.95 


20.35 


Social Adjustment 


29.50 


30.00 


28.70 


28.20 


Flexibility 


42.20 


42.10 


39.30 


41.50 



A semantic differential was developed to identify the attitudes of stu- 
dents over several concepts. Data from the semantic differential were analyzed 
to determine differences and similarities between groi5>s, change in attitude 
toward concepts during the year, and a comparison of attitudes between con- 
cepts. There were no significant differences between groups over any of the 
concepts. The students were most positive on the following concepts: My 
chances for success in life are; My future caureer plans are; and Education 
is. Students were least positive on the concepts dealing with their coitciunity. 
Although analysis of the data on the semantic differential is not quite com- 
plete, it appears that the length of time in the program did positively affect 
the strength of the feelings. The first group of students consistently rated 
the concepts higher than the second groiqp. A detailed report on the analysis 
of the semantic differential is available in Technical Report No. 39, Changes 
in Students* Attitudes as Measttred by a Semantic Differential Instrument. 

The Kuder Occupationcd Interest Survey was administered to all students 
as a pretest and as a post-test. The analysis of the data indicates that 
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the nxamber of interests for boys and girls remained stable between entrance 
into the program and completion of the program. Pew signifies nt differences 
could be found from a comparison of groups or over time periods. A detailed 
report on the analysis of the Kuder can be found in TechniccUL Report No. 40, 
An Investigation of Students* Scores on the Kuder Occupational Interest Survey 
as an Indicator of Program Outcomes. 

Parents 

A questionnadre Csee Appendix H) was given to each set of EBCE peurents 
at the end of the first quarter of the school year. Fourteen (66%) of the 
parents returned the questionnadre. Of those returning the questionnaire # 
atll p£u:ents indicated the EBCE program was better than (12 of 14) or as good 
as (2 of 14) the educational programs from past years. 

A small random san^le of parents were interviewed over the telephone by 
the evaluator at the close of the first semester. Although the purpose of 
the interview was to get parental opinion on an EBCE program instrument/ all 
parents volunteered their appreciation cind continued support of the EBCE 
program* 

As mentioned earlier in this report, parents were contacted again at the 
close of the sdiool year cind arrcingements wsre made for an end-of-year parent 
interview. The inteirviews were conducted by Program Managers upon completion 
of two half-day training sessions. The interviews were arranged with 31 of 
the 44 parents. Some of the questions and responses of this interview per- 
tained to parents* attitudes toward the EBCE program. They were: 

Question 1: How did the Career Education Program in which your child 
participated compare with his/her educational program from past years? 
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Response: Twenty-^seven of the 31 pcurents interviewed (87%) rated the 
EBCE program better. One peirent rated the EBCE program about the same and 
one parent rated the previous program better than the EBCE program. 

Question 9: Knowing what they know now, would they still want their 
child to participate in EBCE? 

Response: Twenty-seven of the 31 parents interviewed (87%) would still 
want their son or daughter to participate. 

Question 10: Would they want a yoiuiger son or daughter to participate 
in EBCE? 

Response: Twenty-six of the parents (84%) would want their younger son 
or daughter to participate in the EBCE program. A detailed description and 
analysis of the parent interview can be found in Tedinical Report Ko. 43, 
Parents* Attitudes Toward the Program as Indicated by an Analysis of Interview 
Data. 

Employers 

Although program staff interacted with employers regularly and frequently, 
a direct and structured evaluation of employer attitude toward the EBCE program 
was not accomplished. There is, however, data and evidence available to pre- 
sent some information on employer attitude. A large portion of the available 
data was derived from an interview of the employer liaison person of AEL. 

A total of 69 employers was requested during the year to actively parti- 
cipate in the EBCE program. Of the 69 employers contacted, 64 agreed to coop- 
erate, two employers refused to cooperate, one employer indicated reorganiza- 
tion problems and wished to delay participation, one employer agreed to 
participate and then withdrew before the sdiool year steirted, and one employer 
participated initially and then withdrew because of an internal struggle. 

ERIC 
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There are xoany ixistances which can be cited of positive interaction of 
employers cmd EBCE students* An oral surgeon was willing to start at 7:00 
a*m. cuid allow a student to observe surgery, and one employer indicated a 
change in hiring policy from one of not hiring inexperienced youth to one 
of looking for youthful applicants* The latter employer indicated his suc- 
cess with EBCE students as a reason for this change in policy, and a number 
of employers did hire some of the graduates of the EBCE program as a result 
of their interaction during the year* A small number of employes indicated 
that the students performed some of the activities (particularly research 
type activities) as well as some or their bcdlf , and one of the employers 
indicated the students had done signif icaiit research for their organization. 
There was sasa evidence that a very small nuinber of employer sites had become 
more positive in their attitude toward hiring women and blacks, and as of 
September 1, 1973, there were indications that all who had participated in 
the program in FY 73 were willing to participate again. 

A number of instances can be identified as troublesome areas. In sjpite 
of specific dress code ipfcnuacion by some employers, a few students did not 
comply. Approximately 10% of the students abused scheduled appointments 
during the year; however, there were indications that this improved rear the 
end of the year. Minor conduct violations caused a few of the employers some 
concern. 



In June of 1973 , the Appalachia Educational Laboratory (AEL) completed 
the first year of development and testing of the EBCE program. Twenty-one 
students participated in the program the enUre year CGro\^ I) and 23 more 
students participated in the program from Janaury through May of 1973 



Summary and Conclusions 
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(Group II) . Data from these 44 students were gathered and analyzed throughout 
the academic yeau:. 

Although datai other than national norms, were not available to enable 
cocTiparisons of the EBCE program with other educational programs, several 
tentative conclusions axe possible. These conclusions are preliminary state- 
ments of the degree to which program objectives were reached. The program 
goals are stated here with a brief discussion of the conclusions reached 
based on the 1972-73 evaluation results. 

Ck>al: Students will make a realistic career choice based on abilities, 
interests, and values and the requirements of selected Ccureer choices. 

Conclusion: Although direct c^jective data were not available, data 
from Student Interviews and from the Career Development Inventory would 
indicate that a majority of the students were making realistic career cdioices. 

Goal: students will increase their knowledge of the variety of opportuni 
ties in the world of work. 

Conclusion: Data from the student and parent interviews provide strong 
indications that SBCE students did become more knowledgeable of the variety 
of opportunities available to them in the world of work during the EBCE pro- 
gram. This claim was not sax^s tan ti at ed by the results obtained from the 
Knowledge subtest of tlie CUi, 

Goal: students will identify the functional, adaptive, and specific 
skills required for selected work situations of their choice. 

Conclusion: Although there was considerable program emphasis on this 
goal, available rftsources did not permit a systematic evaluation of the 
achievement of this goal. 

Goal: students will develop acceptable problem-solving, planning, and 

decision-making skills. 
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Conclusion: The Career Development Inventory was used to measure achieve- 
ment of this goalr and the results were mixed. Group I had statistically 
significr-\t gains in Part A (Planning Orientation) , Part B CResources for 
Exploration) ^ and demonstrated growth (not statistically significant) on 
Part C (Information and Decision Making) • Group II had a slight gain on 
Part A (non-significant) , a loss on Part Br and a significant loss on Part C* 
Group I stv.dents tended to demonstrate greater gains during the first part 
of the year than during the latter part of the year. It is important to 
note that Group II obtained a different pattern of results than either the 
first or sec^^nd term Group I results. 

(roal: Students will document their educational needs in relation to 
their career and/or academic goals. 

Conclusion: There is positive evidence from examination of the Student 
Activity Sheets and verification from the student and parent interviews that 
each student had -an individualized and personalized program. 

Goal: students will have the skills and education necessary (including 
coinm\ini cation skills) to enter his c-.:eer area or will be able to pursue the 
career at a higher educational level. 

Conclusion. A canpaxison with national norms indicated that students 
who participated in the EBCE program the full year demonstrated academic 
growth at least as great as that v;hich could be expected from students in 
conventional school settings. There was significant evidence that the EBCE 
students grew more than expected according to comparisons with national norms 
in tne areas of language arts and mathematics. The EBCE students again tended 
to demonstrate greatest gains during the first semester and small gains or 
regression between midyear and end-of-year testing. 
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Goal: Students will develop their abilities, interests, and values 
within the context of selected career areas 

Conclusions When compared with national norms, students demonstrated 
expected academic growth on the Iowa Tests of Educational Development. Par- 
ents and students both volunteered the opinion that the most valuable aspect 
of the program was the amount of knowledge the students had gained about 
selected careers through the EBCE program. 

Goal: Students will identify, critically examine, and evaluate his/her 
value system against encountered views on social issues. 

Conclusions : Although there is evidence that a few students exerted 
a great deal of effort in this area, there was no systematic collection of 
data to indicate if this goal wcis achieved. 

Goal: Students will identify the opportunities in the community and 
in the world of work for fulfilling personal, social, and recreational interests. 

Conclusion: Students who had participated in the EBCE program for the 
full year demonstrated a significant positive change in attitude on the seman- 
tic differential concepts dealing with the community. Student interviews indi- 
cated that they felt the job placements had contributed to fulfilling personal 
career interests. However, analysis of data from the Student Information Sys- 
tem Questionnaire revealed that the EBCE students were significantly below 
national norms on the Social and Personal Adjustment Scales, both at entrance 
and exit from the program. 

Goal: Each cooperating employer will identify and provide a resource 
person to work directly with EBCE students, provide direct assistance to help 
students complete EBCE activities, and provide interested students with moti- 
vation. .for becoming qualified in a career area. 
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Conclusion: Evidence from the EBCE employer liaison person indicated 
that the employers who were requested did provide resource persons \^ 
assisted students very capably. Student interviews tended to substantiate 
this conclusion. 

Goal: Employers *^o have participated with EBCE students will have a 
more positive attitude toward their role and a sense of greater responsibility 
in the education of today's youth. 

Conclusion: All en^loyers who participated in the EBCE program in FY 73 
have expressed an intention to participate again during FY 74. Unsolicited 
statements from a few employers indicate a positive attitude toward the program. 

Goal; Pcirents of participating youth will have a positive attiU toward 
the AEL/EBCE program. 

Conclusion: There is evidence from the interviews that parents were very 
positive toward the EBCE program. For example, 26 of 31 parents indicated 
that they would want a yoxinger sibling to participate in the program. 

Conclusion: Students expressed very positive attitudes toward the EBCE 
program during student interviews. 

Discussion 

A review and analysis of data received from t>tudents present evidence of 
several phenomenon of special concern. In many instances, scores became much 
higher and more positive by midyear testing and tended to remain stable or 
regress by tht= end of the year. There are several reasons why this might have 
happened- Regardless of program type, seniors seem to take academic endeavors 
and especially tests less seriously in May when they have ccmpleted nearly all 
their scheduled activities. Also, there is some evidence that the treatment 
was somewhat different the second part of the year than during the first half. 
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Empirical evidence to support this concern is especially noticeable in the 
results of the Career Development Inventory analysis, A third possible 
reason for the lack of second semester gains is that there were only 75 days 
allotted to the second semester compared with 98 days for the first semester. 
The program stsdEf may wish to encourage additional activitier designed to 
keep students working at optimum levels throughout the entire year^ 

Although a cost analysis of the EBCE program was not completed, there is 
some concern that the operations staff will have difficulty in reaching their 
FY cost ratio goal of $2,000 per student. Their success in meeting this goal 
will be ascertained through the FY 74 cost analysis study, but preliminary 
indications are that the program had many positive accOTiplishments but was 
also expensive ♦ 

There was a laxqe amount of data collected on the EBCE students which was 
indicative of program success. However, without adequate data for comparison 
with other programs, only tentative conclusions can be made* It would seem 
particularly useful to have controlled end-of-year comparisons when senior 
responses to tests are somewhat uneven at best* 

A large amount :^f useful subjective data were collected from students 
and parents* More carefully designed schema for obtaining data from employers, 
staff, and on ca?ts w^juld provide more definitive insights into the successes 
and fai lares of the E3CE prograja. A multivariate model for data analysis which 
would simultaneously utilize data from several sources might provide addi- 
tional insights into program successes and failures. 
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Niiufcer, Title, and Authors of FY73 EBCE Evaluation Reports 
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Nunber, Title, and Authors of FY73 EBCE Evaluation Reports 



No. Title 

Enyloyer-Based Career Education; Evaluation Summary, 1972*73 by 
Dr. Jeuaes H. Sanders and Dr. Charles L. Bertram 

36 Employer-Based Career Education; Selected Demographic Data from 

Students in the 1972*73 School Year by Dr. John T. Seyfarth, 
Dr. James H. Sanders, and Dr. Charles L. Bertram 

37 En^loyer^Based Career Education; Analysis of Scores on the Career 

Develo^Mnent Inventory by Dr. John T. Seyfarth, Dr. James H. 
Sanders, and Dr. Cheurles L. Bertram 

38 Employer-Based Career Education; Analysis of Scores on the Iowa 

Tests of Educationeil Development by Dr. James T. Ranson, Dr. 
James H. Sanders, and Dr. Ciarles L. Bertram 

39 Employer^-Batsed Career Ediacation; Changes in Students' Attitudes as 

Measured by a Semantic Differential Instrument by Dr. James T. 
Ranson, Dr. James H. Semders, and Dr. Cheurles L. Bertram 

40 Employer-Based Career Education; An Investigation of Students ' 

Scores on the Kuder Occupational Interest Survey as an 
Indicator of Program Outcomes by Dr. Ermel Stepp, Dr. James H. 
Sanders, and Dr. Oiarles L. Bertram 

41 Employ er-Based Career Education; Analysis of Data from the Student 

Information System by Dr. James T. Ranson, Dr, James H. Sanders, 
cuxd Dr. Charles L. Bertram 

42 Employer-Based Career Education: Students* Attitudes Toward the Program 

as Indicated by a^i Analysis of Interview i:)ata by Dr. John T. 
Seyfarth, Dr. James H. Sanders, emd Dr. Charles L. Bertram 

43 Employer-Based Career Education; Parents* Attitudes Toward the Program 

as Indicated by an Analysis of Interview Data by Dr. John T. 
Seyfarth^ Dr. James H. Sanders, and Dr. Charles L. Bertram 

44 Employer-Based Career Education: An Investigation of the Use of 

Student Activity Sheets by Dr. John T. Seyfarth, Dr. Richard F. 
Meckleyr Dr. James H. Sanders, and Dr. Charles I*. Bertram 
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Numbers of St\idents Placed at Employer Sites 1972-73 
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i^pendix C 
Employer Site/Cluster Distribution 
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X 




X 


















X 


C. R. Adams, Jr., D.D.S. 


























X 


X 




Advertising, Inc, 


























X 




X 


Appalachia Educational Laboratory, Inc. 








X 






X 
















M 


Appalachian Research & Defense Fund 




























X 




Bert Wolfe Ford Oo. 


|t> 


X 
























X 




Boll Furniture Company 
























X 








Brown Electric Co., Inc. 


























X 






Capitol Cablevision Corporation 










X 




X 












X 


X 




Charleston Area Chamber of Commerce 






X 








X 


















Charleston Art Gallery 










X 


X 


X 






X 










X 


City of Charleston: City Government 














X 






X 






X 






Traffic Control 














X 












X 






Fire Department 














X 












X 






Police Department 


























X 




X 


Charleston Daily Mail 








X 






X 
















X 


Charleston Human Rights Commission 




X 




X 


X 




X 
















X 


Charleston National Bank Travel Agency 
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X 






X 












X 




X 


C & P Telephone Company 








X 






X 
















X 


Diran Coanporation 




X 




















X 






X 


Dobbins, Fisher & Pittman, Real Estate 






















X 










Electronic Specialty Company 




l< 




X 
















X 








Henry T. Elden Associates 




X 
























X 


X 


Embee's Ladies Department Store 




X 
























X 


X 


Eskew, Smith & Cannon 












X 
















X 




Fas-Chek Food Markets 


r X 








X 










X 












General Aviation Service 














X 


















Governor's Commission on crime & Delinquency 








X 
























Harden & Haarden Funeral Home 








X 


X 




X 
















X 


Holiday Inn (Charleston House) 


;\ X 




























X 


Kanawha County Board of Education 








X 


X 




X 


X 


X 














Kanawha County Parks and Recreation 








X 






X 
















X 


Kanawha County Court 


r 




X 


X 


X 




X 












X 






Kanawha County Public Library 






X 


























Kanawha Players 










X 




X 


X 


X 














Kanawha State Forest 








X 




















X 


X 


Kanawha Valley Multiple Listing Service 




X 








X 


















X 


Kroger 
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Oakwood Pharmacy 
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Mid-Appalachian Environmental Service 
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X 


X 














X 






X 




Motintain Artisans 










X 






















X 


Penn Mutual Life Insurance Co. 






X 




X 










X 














Charles T, Price Landscape Architect 
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X 




















Shoney * s 






X 






















X 


X 


X 


Stone & Thomas Department Store 




X 






X 




X 


X 
















X 


Thomas Memcrial Hospital 










X 






X 


















Triangle Coimunity Sdiooi 












X 










X 












Travelmates, Inc. 
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Trojan Steel 
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X 
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Union Ceurbide Corporation 
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U. S. Marine Corps Recruiting Office 




X 












X 












X 


X 




KMUL-TV 




X 












X 












X 


X 




WTIP-Radio 




X 










X 


X 






X 




X 








W. Va. Air Natic al Guard 




X 




























X 


W. Va. College of Graduate Studies 






X 




X 
























W. Va. Council of Churches 














X 


X 


X 


X 














W. Va. Department of Agriculture 














X 


X 


















W. Va. Depi>rtment of Health 










X 




X 


X 


















W. Va. Deparisie'it of Mental Health 
















X 


X 


X 














W. Va. Depart^nert of Natural Resources 














X 


X 


















W. Va. Deparunert of Public Safety 










X 






X 
















X 


W. Va. Human Rights Coinmission 
















X 
















X 


W. Va. Treasure ^* 




X 






X 




X 


















X 


Charles E. Wr* ,ht, Jr., D.D.S. 












X 


X 


X 


















YMCA 
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Name Age Sex 

DIPECTIONS 

i. This survey is to let you describe hcM you feel or what you think. 

2* Show what you think about the concept (phrase) on the top of each 
page by placing an "X" in one of the seven blanks between each set 
of adjectives (from very good to very bad) . 

3. Use only one mark for each pair of adjectives, but each pair should 
have one mark* 

4. There au:e no right or wrong answers. Your first thought is usually 
the best one to record. 

Example : 

Please react to the concept: 

ICE CREAM 

Good Bad 



You might have reacted to the concept ICE CREAM in one of seven ways< 
The following illustrates the seven different ways you might have marked 
with an interpretation of each alternative. 



Good Bad 

Very Good X 

Moderately Good X 

Somewhat Good X 

So-So or 

Maybe no Meaning X 



Somewhat Bad 
Moderately Bad 
Very Bad 
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MY CHANCES FOR SUCCESS IN LIFE ARE: 



wise 

valuable 

good 

weak 

consistent 
fair 

progressive 

con^lete 

me2ming£ul 

successful 

unimportemt 

discouraging 

interesting 

hazy 

dirty 

releuced 

ugly 

sharp 

weak 

colorful 



foolish 

worthless 

bad 

strong 

inconsistent 

unfair 

traditional 

incomplete 

meaningless 

unsuccessful 

important 

encouraging 

boring 

clear 

clean 

tense 

beautiful 

dull 

powerful 
colorless 



MY FUTURE CAREER PLANS ARE: 



wise 
valuable 
good 
weak 

consistent 
fair 

progressive 

complete 

meaningful 

successful 

unimportant 

discouraging 

interesting 

hazy 

dirty 

relaxed 

ugly 

sharp 

weak 

colorful 



foolish 

worthless 

bad 

strong 

inconsistent 

unfair 

traditional 

incomplete 

meaningless 

unsuccessful 

important 

encouraging 

boring 

clear 

clean 

tense 

beautiful 

dull 

powerful 
colorless 
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MY RESPONSIBILITY TO THE GOVERNANCE OF MY COMMUNITY IS: 



wise 
valuable 
good 
weak 

consistent 
fair 

progressive 

complete 

roeamingful 

successful 

unimportant 

discouraging 

interesting 

hazy 

dirty 

relaxed 

ugly 

sharp 

weak 

colorful 



foolish 

worthless 

bad 

strong 

inconsistent 

unfair 

traditional 

incoi^lete 

meemingless 

unsucces^^ful 

import an 

encouraging 

boring 

clear 

clean 

tense 

beautiful 

dull 

powerful 
colorless 



EDUCATION IS: 



wise 
valuable 
good 
weaik 

consistent 
fair 

progressive 

complete 

meaningful 

successful 

unimportant 

discouraging 

interesting 

hazy 

dirty 

releuced 

ugly 

sharp 

weak 

colorful 



foolish 

worthless 

bad 

strong 

inconsistent 

unfair 

traditional 

incomplete 

meaningless 

unsuccessful 

important 

encouraging 

boring 

clear 

clean 

tense 

beautiful 

dull 

powerful 
colorless 
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I AM: 



wise 
valuable 
good 
weak 

consistent 
fair 

progressive 

complete 

meaningful 

successful 

unimportetnt 

discouraging 

interesting 

hazy 

dirty 

relaxed 

ugly 

sharp 

weak 

colorful 



foolish 
worthless 
bad 
strong 

inconsistent 

unfair 

traditional 

incomplete 

meaningless 

unsuccessful 

important 

encouraging 

boring 

clear 

clean 

tense 

beautiful 

dull 

powerful 
colorless 



THE RECREATION FACILITIES AVAILABLE TO ME IN MY COMMUNITY ARE: 



wise 
valuable 
good 
weak 

consistent 
fair 

progressive 

complete 

meaningful 

successful 

unimportant 

discouraginr, 

interesting 

hazy 

di rty 

relaxed 

ugly 

sharp 

weak 

colorful 



foolish 
worthless 
bad 
strong 

inconsistent 

unfair 

traditional 

incomplete 

meaningless 

unsuccessful 

important 

encouraging 

boring 

clear 

clean 

tense 

be^^utiful 

di 

p. 'ul 
colorless 



ERLC 



49 



THE SOCIAL CC»JTRIBUTIONS OF MY COMMUNITY TO MY WELL BEING ARE: 



wise foolish 

valuable ~ZZ worthless 

good bad 

weak strong 

consistent inconsistent 

fair unfair 

progressive traditional 

complete incoit5)lete 

meaningful meaningless 

successful unsuccessful 

unimportant important 

discouraging encouraging 

interesting boring 

hazy clear 

dirty clean 

relaxed ZUL tense 

ugly beautiful 

sharp dull 

weak powerful 

colorful colorless 



ALL OCCUPATIONS AREi 



wxse 
valuable 
good 
weak 

consistent 
fair 

progressive 

complete 

meaningful 

successful 

unimportant 

discouraging 

interesting 

hazy 

dirty 

relaxed 

ugly 

sharp 

weak 

colorful 



foolish 

worthless 

bad 

strong 

inconsistent 

unfair 

traditional 

incomplete 

meaningless 

unsuccessful 

important 

encouraging 

boring 

clear 

clean 

tense 

beautiful 

dull 

powerful 
colorless 
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MY CONTRIBUTIONS TO MY COMMUNITY ARE: 



v^ise foolish 

valuable ZZZ! ZZH ZZZI IZZZ worthless 

good bad 

weak 3IZ ZZI strong 

consistent inconsistent 

fair unfedr 

progressive traditional 

complete incomplete 

meaningful ^^^H ZZZ meaningless 

successful unsuccessful 

unimportant in5)ortant 

discouraging encouraging 

interesting boring 

hazy clear 

dirty cleam 

relaxed tense 

ugly beautiful 

sharp ZZZ ZZZ ZZZ ^^^^ 

weak powerful 

colorful colorless 
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Activity Sheet 



>ate Closed: 



A.S.No. 



^i:udent: 




;tart Date: 


Estimated 
Close Date: 


Specific Goals (Behavioral Objectives) 


initiator: 




ioal/Keed: j | 


PR 1 1 Student 




:ssue/Concept /Topic / 


Etc. 




!areer 






Icademic 






lersonal Development 







ICTIVITIES: List and Describe 



ludent Comments & Assessment of the Learning Activity: 
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Student Inter -'iew Form 

What are your immediate plans? 

a* Loaf 

b. Work 

c. Go to school 
d* Go to service 
e* Housewife 

How long do you plan on doing "this"? 



Why are you planning on doing "this"? 

Do you now know what career you intend to follow? 

Did t:he EBCE program influence your decision in any wayl 



You indicated at ths beginning of the a desire or interest in 

the (career) • Do you still intend to pursue ^? 



What are ths reasons why you are or are not? 
Did the EBCE program have any influence? 

What are the things you remember most of the employer sites you liked best? 
..•.you liked least? 



Do you now have more or less jobs or job opportunities of interest to you? 
(Explain J 



Do you now have more or no more job opportunities that you know about? 
(Explain J 
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. 5. Which site had the most positive effect on you? 
••..most negative effect on you? 

How were you treated at the employer site? (Part of the group or on your own) 

6^ can you tell me what you expected from the EBCE program when you first 
entered the program? 

Was the program the same as what you thought it would be? (Explain.) 
1. How well did the EBCE program meet your school requirements? 
....career or job interests? 

8. Do you have any interests now that you did not have previoxosly? 
Ccireer — 

Non-career-- 

9. What have you specifically gained from tHe EBCE program? 

10. What would you have gained more of at your home school? 

11. Would you select to participate in the EBCE program again? 

12. If you were given the opportunity to spend another year with the EBCE 
program, would you? 

13. What changes should be made in the EBCE program to make it a better program? 

14. Did you have enough peer (explain) interaction or did you feel left out 
of events with students your own age? 

IS^ What or how did you interpret education on the Semcintic Differential? 




(^2 
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Parent Interview Schedule 

Parent 

Interviewer 

Date Time 



1. How did the Career Education Program ( ) 

participated in compare with his (her) educational progrcun from past 
years? (Possible variables: educational value, work lead, etc., 
overall) 

Better About the same Worse 



Explain. 



2, Do you believe ( ) liked his (her) program 

Better About the same Worse this year as compared 

with last year? 

Explain, 



3. Have you noticed any specific changes in the behavior of ( 

) during the past year? (Examples might be -.aore confi-- 
dence, better self-concept, less disciplined, etc.) 

List positive changes. 



List negative changes. 
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Do you believe ( .) learned as much in his 

(her) subject areas this year as compared to last year? 

Better About the same Worse Don't know 



Explain. (Probe into anount of work done, understanding, etcj 



What do you believe (_ ) would have gained more 

of at his (her) home school? 



What do you believe ) gained more of in the 

EBCE program than he (she) would have in the home school? 



What would you consider the greatest weaknesses of the program? 
(Possibly a probe would be what changes...) 



What would you consider the greatest strengths of the program? 
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9* How has the urogram affected ( } career plans? 

(Have they changed?) 

More sure No change Less sure 

Explain* (One probe might be - Are you happy with the choice or decision?) 



10 • Would you want (_ ) to participate in the 

progreun again knowing what you now know? 

Yes No 

Why? 



11* If you have (or had) a younger son or daughter, would you want him or her to 
participate? 



Yes No 

Why? 



12* Do you believe you have received enough information Ixom the staff about 
( ) progress? 

Yes No 



Why or where? 
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13 ♦ Do you have any other coraroents you would like to make about the program 
(positive, negative, or suggestions)? 



Interviewer's Summary Statement: 



«7 
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APPALACHIA 

p. 0. BOX 1348 

CHARLESTON, WEST VIRGINIA 25325 

304/344-8371 



Dear Mr. and Mrs. 

As you know, the Career Education Program 

participating in this year is in a continuing process of iii5)roveinent 
and therefore an evaluation of efforts to date is extremely important. 

You can help us to in^rove the program for and to help 

make it a better program for next year if you would answer the following 
questions. Please return the answered questions in the enclosed self- 
addressed envelope. 

1. To what extent does talk about the Career Education 

Prograon at home? 

A great deal Some None 

2. How does the Career Education Program compare with the educational 
programs from past years? 

Better About the same Worse 



Please explain the reason for your answer. 
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3* For whom would you recommend this Career Education Program? (choose one 
answer) 

All students 

All college bound students 

All students not going to college 

All students not satisfied with their present school 

No students 

Other 

Please explain the reason for your choice. 



4* Have the career plans for changed since the start of 

the program? 

Yes No 

If you answered yes, would you please explain how the plans have changed? 



5. Do you find the Career Education Program's reporting system adequate in 
providing you with information about 1 

Yes No 

What do you particularly like or dislike about the reporting system? 



6. Do you feel that you are always able to talk with the program staff? 



Yes 



No 
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Mr* and Mrs. 

Page 3 



Woxild you jot down some ideas you might have for improving the program? 



Sincerely, 



James H. Sanders, Ed.D. 

Evaluation Specialist 

Research and Evaluation Division 



JHS/fda 
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